Serial No. 10/820,906 

Response to office action of March 20, 2007 
Amendments to the Claims 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. 

Listing of Claims: 

1-31 (canceled). 

32. (new) A system for use in managing activity of interest within an 
enterprise, comprising a computer having a model for tracking objects in a 
scene related to the enterprise and configured to 

(i) access key activity data comprising object data related to the features, locations, and 
activity of an object relative to other physically and visually distinct objects in a 

scene related to the enterprise, 

(ii) receive sensor data that is taken in by a sensor of a predetermined scene related to the 
enterprise, 

(iii) extract solely from the sensor data changes that enables separation of 
foreground and background objects, localization of object features, and 
connection of object features that should be connected, 

(iv) classify the extracted objects in plurality of classes of objects of different features, 
shapes, and behavioral patterns, 

(v) determine whether an object is new to the object data in the computer and if so 
initiating tracking of the object and if the object exists as object data in 

the computer updating a track of the object, and update the computer model 
in accordance with the foregoing, and 

(vi) compare object data to key activity data to determine whether to generate a key 
activity message. 

33. (new) A system as defined in claim 32, wherein the computer is configured to make a 
preliminary determination from the sensor data as whether to extract from the sensor data one or 
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more objects and the state of activity for each object with respect to the state of activity of other 
physically distinct objects in the sensor data, irrespective of objective compliance. 

34. (new) A system as defined in claim 33, wherein in extracting from the sensor data the object 
and the state of activity for the object with respect to other physically distinct objects in the 
sensor data, irrespective of object compliance, the computer is configured to determine if the 
object has been previously extracted from sensor data or is being initially extracted from the 
sensor data. 

35 (new). A system as defined in claim 34, wherein the computer is configured such that after 
the computer has processed the key activity data and the extracted data and determined whether 
to produce output that is related to the key activity, the computer is configured to receive 
additional sensor data taken in by the sensor of the predetermined scene related to the enterprise, 
extract from the additional sensor data an object and the state of activity for the object with 
respect to the state of activity for other physically distinct objects in the sensor data, irrespective 
of object compliance, and process the key activity and the extracted data from the additional 
sensor data and determine whether to produce output that is related to the key activity. 

36 (new) A method for use in managing activity of interest within an enterprise, comprising 

a. providing a computer configured to (i) access key activity data comprising data 
related to activity of an object relative to other physically and visually distinct 
objects in a predetermined scene related to the enterprise, (ii) receive sensor data 
that is taken in by a sensor of a scene related to the enterprise, (iii) extract solely 
from the sensor data an object and the state of activity for the object with respect 
to the state of activity for other physically and visually distinct objects in the 
sensor data, irrespective of object compliance, and (iv) process the key activity 
data and the extracted data and determine whether to produce output that is 
related to the key activity; 



3 



Serial No. 10/820,906 

Response to office action of March 20, 2007 

b. inputting to the computer sensor data that is taken in by a sensor of a scene related 
to the enterprise; 

c. extracting solely from the sensor data, via the computer, an object and the state of 
activity for the object with respect to the state of activity for other physically and 
visually distinct objects in the sensor data, irrespective of object compliance; and 

d. processing the key activity data and the extracted data and determine whether to 
produce output that is related to the key activity, and 

e. storing the detected activities in a database for extraction and use in a decision 
support system. 

36 (new) A method as defined in claim 35, wherein a preliminary determination is made, via 
the computer, from the sensor data as to whether to extract from the sensor data the object 
and the state of activity for the object with respect to the state of activity of other physically 
distinct objects in the sensor data, irrespective of objective compliance. 

37 (new) A method as defined in claim 36, wherein in extracting from the sensor data the 
object and the state of activity for plurality of objects in the scene with respect to other 
physically distinct objects in the sensor data, irrespective of object compliance, the computer 
determines if the object has been previously extracted from sensor data or is being initially 
extracted from the sensor data. 

38 (new). A method as defined in claim 37, wherein after the computer has processed the key 
activity data and the extracted data and determined whether to produce output that is related 
to the key activity, the computer (i) receives additional sensor data taken in by the sensor of 
the predetermined scene related to the enterprise, (ii) extracts from the additional sensor data 
an object and the state of activity for the object with respect to the state of activity for other 
physically distinct objects in the sensor data, irrespective of object compliance, (iii) processes 
the key activity and the extracted data from the additional sensor data and determines 
whether to produce output that is related to the key activity and (iv) update the already stored 
information of the key activity of the object. 
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